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Abstract 

Feedback is a most important concept in control systems, its main purpose 
is to deal with internal and/or external uncertainties in dynamical systems, 
by using the on-line observed information. Thus, a fundamental problem in 
control theory is to understand the maximum capability and potential limits 
of the feedback mechanism. This paper gives a survey of some basic ideas and 
results developed recently in this direction, for several typical classes of un- 
certain dynamical systems including parametric and nonparametric nonlinear 
systems, sampled-data systems and time-varying stochastic systems. 
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1. Introduction 

Feedback is ubiquitous, and exists in almost all goal-directed behaviors [1]. It 
is indispensable to the human intelligence, and is important in learning, adaptation, 
organization and evolution, etc. Feedback is also the most important concept in 
control, which is a fundamental systems principal when dealing with uncertainties 
in complex dynamical systems. The uncertainties of a system are usually classi- 
fied into two types: internal (structure) and external (disturbance) uncertainties, 
depending on the specific dynamical systems to be controlled. Feedback needs in- 
formation, and there are also two types of information in a control system: a priori 
information and posteriori information. The former is the available information 
before controlling a system, while the later is the information exhibited by the sys- 
tem dynamic behaviors. It is the posteriori information that makes it possible for 
the feedback to reduce the influences of the uncertainties on control systems. Two 
of the fundamental questions in control theory are: How much uncertainty can be 
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dealt with by feedback ? What are the limits of feedback ? These are conundrums, 
despite of the considerable progress in control theory over the past several decades. 

The existing feedback theory in control systems can be roughly classified into 
three groups: traditional feedback, robust feedback and adaptive feedback. In the 
ideal case where the mathematical model can exactly describe the true system, 
the feedback law that are designed based on the full knowledge of the model may 
be referred to as traditional feedback. Unfortunately, as is well known, almost 
all mathematical models are approximations of practical systems, and in many 
cases there are inevitable large uncertainties in our mathematical descriptions. The 
primary motivation of robust and adaptive control is to deal with uncertainties 
by designing feedback laws, and much progress has been made in these two areas. 
Robust feedback design allows that the true system model is not exactly known 
but lies in a "ball" centered at a known nominal model with reliable model error 
bounds(cf. e.g. El, 0). 

By adaptive feedback we mean the (nonlinear) feedback which captures the un- 
certain (structure or parameter) information of the underlying system by properly 
utilizing the measured on-line data. The well-known certainty-equivalence princi- 
ple in adaptive control is an example of such philosophy. Since an on-line learning 
mechanism is usually embedded in the structure of adaptive feedback, it is conceiv- 
able that adaptive feedback can deal with larger uncertainties than other forms of 
feedback can do. Over the past several decades, much progress has been made in 
the area of adaptive control (cf. e.g. 0-0)- For linear finite dimensional systems 
with uncertain parameters, a well-developed theory of adaptive control exists today, 
both for stochastic systems (cf. and for deterministic systems with small 

unmodelled dynamics (cf. [Hj). This theory can be generalized to nonlinear sys- 
tems with linear unknown parameters and with linearly growing nonlinearities (cf. 
e.g.|12|). However, fundamental difficulties may emerge in the design of stabilizing 
adaptive controls when these structural conditions are removed. This has moti- 
vated a series of studies on the maximum capability (and limits) of the feedback 
mechanism starting from 

To explore the maximum capability and potential limits of the feedback mech- 
anism, we have to place ourselves in a framework that is somewhat different from 
the traditional robust control and adaptive control. First, the system structure 
uncertainty may be nonlinear and/or nonparametric, and a known or reliable ball 
containing the true system, which is centered at a known nominal model, may not 
be available a priori. Second, we need to consider the maximum capability of the 
whole feedback mechanism (not only a fixed feedback law or a special class of feed- 
back laws). Moreover, we need to answer not only what the feedback can do, but 
also the more difficult and important question, what the feedback can not do. We 
shall also work with discrete-time (or sampled-data) feedback laws, as they can 
reflect the basic causal law as well as the limitations of actuator and sensor in a 
certain sense, when implemented with digital computers. 

In this talk, we will give a survey of some basic ideas and results obtained in 
the recent few years (^01 _ EI)j towards understanding the capability and limits of 
the feedback mechanism in dealing with uncertainties. For several basic classes of 
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uncertain nonlinear dynamical control systems, we will give some critical values and 
"Impossibility Theorems" concerning the capability of feedback. The reminder of 
the paper is organized as follows: the problem formulation will be given in Section 
2, and some basic classes of discrete-time parametric and nonparametric nonlinear 
control systems will be studied in Sections 3 and 4, respectively. Other classes of 
uncertain systems, including sampled-data systems and time- varying linear systems 
with hidden Markovian jumps, will be considered in Section 5, and some open 
problems will be stated in the concluding remarks in Section 6. 

2. Problem formulation 

Let {ut, t > 0} be an 7?.™ l -valued input process of a discrete-time or sampled- 
data uncertain dynamical control system (whose structure is unknown or not fully 
known, and is subject to some noise disturbances), and let {yt,t > 0} be the 
corresponding on-line observed 7\L"-valucd output process (see the following figure) . 





1 noise 




uncertain 






system 





At any moment t > 0, the input signal u t is said to be a feedback signal, if 
there is a Lebesgue measurable mapping ht{ ) : TZ^ t+1 ^ n — ► lZ m such that 

u t = Mj/o.J/ij -,yt)- 

In other words, ut is a function of the posteriori information observed up to time t. 
A feedback law u is a sequence of feedback signals, i.e., u — {u t , t > 0}. Furthermore, 
the feedback mechanism U is defined as the set of all possible feedback laws, 

U = {u\ u is any feedback law}. 

For a complex system whose structure contains uncertainties, it is not a simple 
(and in fact difficult) problem to find a feedback law u, such that the corresponding 
output process can achieve a desired goal. This involves questions like: what kind 
of properties of an uncertain dynamical system can be changed by feedback ? how 
to construct a satisfactory feedback based on the available information ? More 
fundamental questions are: how much uncertainty can be deal with by feedback ? 
What are the maximum capability and limits of the feedback mechanism U ? In 
the next three sections, we will present some preliminary results towards answering 
these questions. For further discussion, we need the following definition. 

Definition 2.1. A dynamical control system is said to be globally stabilizable 
if there exists a feedback law u e U, such that the output process of the system is 
bounded in the mean square sense, i.e., 

supi?||j/t|| 2 < oo, for any initial value y n . 
t>o 
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3. Parametric nonlinear systems 

Consider the following basic discrete-time parametric nonlinear system: 

Vt+i = Of{yt) +u t + w t+ i, (3.1) 

where yt, Ut and Wt are the scalar system output, input and noise processes, respec- 
tively. For simplicity, we assume that 

Al) {w t } is a Gaussian noise process; 

A2) 9 is an unknown non-degenerate Gaussian random parameter; 
A3) The function /(•) is known and has the following growth rate: 

f(x) ~ Mx b , as x — > oo, 

where b > 0, M > are constants. Obviously, if b < 1, then the nonlinear function 
/(•) has a growth rate which is bounded by linear growth. This case can be easily 
dealt with by the existing theory in adaptive control (see e.g. |12|1. Our prime 
concern here is to know whether or not the system can be globally stabilized by 
feedback for any b > 1? 

The following theorem gives a critical value of b, which characterizes the max- 
imum capability of the feedback mechanism. 

Theorem 3.1. Consider the system $3.1\) with Assumptions Al)-A3) holding. 
Then b — 4 is a critical case for feedback stabilizability. In other words, 

(i) . If b> 4, then for any feedback law u G U , there always exists a set D (in 
the basic probability space ) with positive probability such that 

\y t \ —> oo, on D 

at a rate faster than exponential. 

(ii) . Ifb < 4, then the least- squares-based adaptive minimum variance feedback 
control Ut = —0tf(yt) where 9 t is the least-squares estimate for 9 at time t, can 
render the system to be globally stable and optimal, with the best rate of convergence: 

T 

y^,{yt - VJ t ) 2 = O(logT), a.s., as T — ► oo. 
t=i 

Remark 3.1. This result is somewhat surprising since the assumptions in 
our problem formulation have no explicit relationships with the value b — 4. We 
remark that the related results were first found and established in a somewhat gen- 
eral framework in |l()j . In particular, the first part (i) was contained in Remark 2.2 
in |ll)j . and was later extended to general unknown parameter case in |12) by us- 
ing a conditional Cramer-Rao inequality. The second part (ii) is a special case of 
Theorem 2.2 in [TU| . 

Remark 3.2. There are many implications of Theorem 3.1. For example, the 
limitation of feedback given in Theorem 3.1 (i) is readily applicable to general class 
of uncertain systems of the form 



yt+i = ft(yt, -,yt-p, u t , -, u t - q ) + w t+ i, 
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as long as it contains the basic class l|3.1[) as a subclass. Theorem 2.1 can also be 
used to show the fundamental differences between continuous-time and discrete- 
time nonlinear adaptive control(see also, \12\). Note that the noise free case can 
be trivially controlled, regardless of the growth rate of the nonlinear function /(•) 
(see 53)- This means that the noise effect in (13. 1|) plays an essential role in the 
non-stabilizability result of Theorem 3.1 (i): the noise effect gives estimation errors 
to even the "best" parameter estimates, which are then amplified step by step by 
the nonlinearity of the system, leading to the final instability of the closed-loop 
systems, despite of the strong consistency of the parameter estimates ( 10 ) . 

Theorem 3.1 concerns with the case where the unknown parameter is a scalar. 
To see what happens when the number of the unknown parameters increases, let us 
consider the following polynomial nonlinear regression: 

yt+i = Qivi 1 + 2 y b t 2 + ■■■ + P y b t p +u t + w t+1 . (3.2) 

Again, for simplicity, we assume that 
Al)' h > b 2 > ■ ■ ■ > b p > 0; 

A2)' {w t } is a sequence of independent random variable with a common dis- 
tribution N(0,1): 

A3)' 9 = \6i ■ ■ ■ 9 p ] T is a random parameter with distribution N(6, I p ). 
Now, introduce a characteristic polynomial 

P(z) = Z p +1 - b lZ P + (h - b 2 )z p - 1 + ■■■ + (6„_i - b p )z + b p , 

which plays a crucial role in characterizing the limits of the feedback mechanism as 
shown by the following "impossibility theorem" . 

Theorem 3.2. // there exists a real number z G (l,&i) such that P(z) < 0, 
then the above system is not stabilizable by feedback. In fact, for any feedback 

law u € U and any initial condition yo G TZ , it is always true that 

E\yt\ 2 — > oo, as t — > oo 

at a rate faster than exponential. 

Remark 3.3. The proof of Theorem 3.2 can be found in [TI], and extensions 
to non-Gaussian parameter case can be found in 12 . An important consequence 
of this theorem is that the system l|3.2|l is not stabilizable by feedback in general, 
whenever b\ > 1 and the number of unknown parameters p is large(see This 
fact implies that the uncertain nonlinear system 

yt+i = f(yt) + u t + w t 

with /(•) being unknown but satisfying 

ll/WII < C X C 2 ||CC|| & , b>l, 

may not be stabilizable by feedback in general. This gives us another fundamental 
limits on feedback in the presence of parametric uncertainties in nonlinear systems, 
and motivates the study of nonparametric control systems with linear growth con- 
ditions in the next section. 
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4. Nonparametric nonlinear systems 

Consider the following first-order nonparametric control system: 

yt+i = f(y t ) + u t + w t+ i, t>o, yoen 1 , (4.1) 

where {yt} and {ut} are the scalar output and input, and {wt} is an "unknown but 
bounded" noise sequence, i.e. \wt \ < w, Vi, for some constant w > 0. The nonlinear 
function /(•) : 1Z 1 — ► 1Z 1 is assumed to be completely unknown. We are interested 
in understanding how much uncertainty in /(•) can be dealt with by feedback. In 
order to do so, we need to introduce a proper measure of uncertainty first. 

Now, define T = {f : 1Z 1 — > 1Z 1 } and introduce a quasi-norm on T as follows: 

11/11 = hm sup — , V/ e T. 

a ^°° (x, y )eK 2 \x-y\+a 

Having introduced the norm |j • |j, we can then define a ball in the space (F , || • ||) 
centered at its "zero" Of with radius L: 

T(L) = {feT: H/ll <L} 

where Op = {/ € T : |/|| = 0}. It is obvious that the size of T{L) depends on the 
radius L, which will be regarded as the measure of the size of uncertainty in our 
study to follow. 

The following theorem establishes a quantitative relationship between the ca- 
pability of feedback and the size of uncertainty. 

Theorem 4.1. Consider the nonparametric control system \4-l\ - Then the 
maximum uncertainty that can be dealt with by feedback is a ball with radius L = 
|+-\/2 in the normed function space (J 7 , \\ ■ ||), centered at the zero Of- To be precise, 

(i) If L < I + \/2, then there exists a feedback law u £ U such that for any 
f G J~(L), the corresponding closed-loop control system \4-l\ is globally stable in 
the sense that 

sup{|y t | + K|} < co, VyoElZ 1 ; 

(ii) If L > | + y/2, then for any feedback law u £ U and any initial value 
yo € TZ , there always exists some f e T(L) such that the corresponding closed-loop 
system \4-l\ is unstable, i.e., 

sup \y t \ = oo. 

t>o 

The proof of the above theorem is given in ^3], where it is also shown that 
once the stability of the closed-loop system is established, it is a relatively easy task 
to evaluate the control performance. 

Remark 4.1. The stabilizing feedback law in Theorem 4.1 (i) can be con- 
structed as follows(see |14p: 



Ut 



if \Vt -y it \>e 
if \yt ~ Vh\ < e 
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where e > is any given threshold. In other words, Ut is a switching feedback 
based on a stabilizing feedback u' t and a tracking feedback u", which are defined as 
follows: 

< = -ft{Vt) + \{k t + b t ) 
where / is the nearest neighbor (NN) estimate of / defined by 

Mvt) = Vi t +i ~ Ui t 

with 

.A . , , 

it = argmm \y t - y t \ 

0<*<t-l 

and where 

b t = min yi, b t = max y { 

0<i<t 0<i<t 

The tracking feedback u" is defined 

u't = -ft(yt)+yt+n 

where {y% } is a bounded reference sequence. It is obvious that u t depends on the 
observations {yo,yi, ■ ■ ■ ,Vt} only. 

One may try to generalize Theorem 4.1 to the following high-order nonlinear 
systems (p > 1): 

Vt+i = f(Vt,Vt-i, ■ ■ - ,2/t-p+i) + u t + m+i (4.2) 

where /(•) : R p — > R 1 is assumed to be completely unknown, but belongs to the 
following class of Lipschitz functions: 

F(L) = {/(•) : \f{x)-f(y)\<L\\x-y\\,Vx,ye1V} 
p 

where L > 0, ||x|| = x = ( a ii ■ ■ • i x vY ^ R P - Again, {wt} is a sequence 

i=l 

of "unknown but bounded" noises. The following "impossibility theorem" is estab- 
lished in |17|. 

Theorem 4.2. If L and p satisfy 

L+l>(l + -)( P L)^h (4.3) 
2 p 

then there does not exist any globally stabilizing feedback law for the class of uncer- 
tain systems with f £ J~(L). 

It is easy to see that if p = 1 then the above inequality l|4.3|) reduces to 
L > | + V2, which we know to be a critical value for the capability of feedback 
by Theorem 4.1. However, when p > 1 and 1)4. 3JI does not hold, whether or not 
there exists a stabilizing feedback for the uncertain system (14.211 with / 6 J~(L) still 
remains as an open question. 
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5. Other uncertain systems 

In this section, we briefly mention some related results on other basic classes 
of uncertain systems. 

Let us first consider the following simple but basic continuous-time system: 

x t = f(x t ) + u u tyo^oen 1 . (5.1) 

The system signals are assumed to be sampled at a constant rate h > 0, and 
the input is assumed to be implemented via the familiar zero-order hold device (i.e., 
piecewise constant functions): 

ut=u k h, kh < t < (k + l)h, (5.2) 

where u kh depends on {x a , x h , ...,x k h}- 

The nonlinear function / in l|5.1|l is assumed to be unknown but belongs to 
the following class of local Lipschitz (LL) functions: 

G L C = {/| / is LL and satifies |/(x)| < L\x\ + c,Vx G i? 1 }, (5.3) 

where c > and L > are constants. The "slope" L of the unknown nonlinear 
functions in G^ may be regarded as a measure of the size of the uncertainty. Similar 
to the discrete-time case in Theorem 4.1, L plays a crucial role in the determination 
of the capability and limits of the sample-data feedback pj] ■ 

Theorem 5.1. Consider the sampled-data control system fE3$}~iE$)- IfLh> 
7.53, then for any c > and any sampled-data control {u k h, k > 0} there always 
exists a function f* G G^ , such that the state signal of corresponding 
to f* with initial point xq = satisfies (fc > 1) 

\x k h\ > (4r) fe_1 - ch — ► °°- 

Z k — >oo 

Remark 5.1. This "impossibility theorem" shows that if Lh is larger than 
a certain value, then there will exist no stabilizing sampled-data feedback. On 
the other hand, it is easy to show that if Lh < log 4, then a globally stabilizing 
sampled-data feedback can be constructed (see |13|L An obvious open question 
here is how to bridge the gap between log 4 and 7.53. Needless to say, Theorem 5.1 
gives us some useful quantitative guidelines in choosing properly the sampling rate 
in practical applications. 

Next, we consider the following linear time-varying stochastic model: 

xt+i = A(6 t )x t + B(9 t )u t + w t+ i, t > 1; (5.4) 

where Xt € TZ n ,u t £ TZ m and Wt+i G TZ n are the state, input and noise vectors 
respectively. We assume that 

HI) {9t} is an unobservable Markov chain which is homogeneous, irreducible 
and aperiodic, and which takes values in a finite set {1, 2, • • • , N} with transition 
matrix denoted by P — (pij)NN, where by definition pij = P{6 t = j\0t-i = *}• 
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H2) There exists some mxn matrix K such that det UAi — Aj) — (Bi — B 3 )K\ ^ 

0, Vi ^ j, 1 < i,j < N, where A z = A(i) E TZ nn , B, = B(i) € TZ nm are the system 
matrices. 

H3) {w t } is a martingale difference sequence which is independent of {0t}, 
and satisfies a I < Ewtiv' t , Ew' t wt < o~ w , Vt, where a and a w are two positive 
constants, and the prime superscript represents matrix transpose. 

For simplicity of presentation, we denote S = {1,2,- •• ,N}. The following 
theorem gives a fairly complete characterization of feedback stabilizability for the 
hidden Markovian model 1)5.4(1 16 . 

Theorem 5.2. Let the above Assumptions Hl)-H3) hold for the dynamical 
system \5.$ with hidden Markovian switching. Then the system is stabilizable by 
feedback if and only if the following coupled algebraic Riccati-like equations have a 
solution consisting of N positive definite matrices {Mi > 0,i € S}: 

]T A'jPijMjAj - ( J2 ^PijMjBj) ( BfcjMjBj)* ( £ BjPijMjAj) -Mi = -I., 

3 3 3 

where i G S and (-) + denotes the Moore-Penrose generalized-inverse of the corre- 
sponding matrix. 

Remark 5.2. Theorem 5.2 shows that the capability of feedback depends 
on both the structure complexity measured by {Aj ,Bj,l < j < N} and the in- 
formation uncertainty measured by < i,j < N}. To make it more clear 
in understanding how the capability of feedback depends on both the complex- 
ity and uncertainty of the system, we consider the simple scalar variable case with 
B{9 t ) = 1, where the Markov chain {8 t } has two states {1, 2} only and p 12 = pi\. It 
can be shown by Theorem 5.2 that the system is stabilizable if and only if CP < 1, 
where C = (A-2 — A\) 2 and P = (1 — p\2)pi2 can be interpreted as measures of 
the structure complexity (degree of dispersion) and the information uncertainty 
respectively (see ^Hl for details). 

6. Concluding remarks 

For several basic classes of uncertain dynamical control systems, we have given 
some critical values or equations to characterize the capability and limits of the 
feedback mechanism, and have shown that "impossibility theorems" hold even for 
some seemingly simple uncertain dynamical systems. Of course, many important 
problems still remain open. Examples are as follows: 

(i) For general high-dimensional or high-order uncertain nonlinear control sys- 
tems, to find critical conditions characterizing the capability of feedback, at least 
to find general sufficient conditions under which feedback stabilization is possible 
in the discrete-time case. 

(ii) To characterize the maximum capability of feedback that is designed based 
on switched linear control models, in dealing with uncertain nonlinear dynamical 
systems. 
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(iii) To find a suitable mathematical framework within which the issue of 
establishing a quantitative relationship among a priori information, feedback per- 
formance and computational complexity can be addressed adequately. 
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